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proposed represents the variables of achievement, students* sense of 
efficacy, motivation, and parents* attitudes as completely 
interdependent. Thus, the latter three variables are of interest 
because not only do the-* affect achievement levels but they 
themselves are affected by achievement. The data used to estimate 
this system were derived from the Equal Opportunity Survey on which 
the Coleman Report was based. The sample is composed of sixth grade 
students in a large eastern city who had attended only the school in 
which they were enrolled at the time of the survey, 1965-66. Teacher 
characteristics are based upon averages for all the teachers in each 
school who were teaching in grades three to five. Since both 
explanatory variables and those which are going to be explained are 
interdependent, their values must be solved simultaneously in order 
to obtain unbiased estimates of their effects. The findings indicate 
that educational programs focusing on student attitudes may be able 
to compensate for « disadvantages 1 ' in socioeconomic background. (JM) 
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A New Model of School Effectiveness 



Introduction 

The subject of how schools affect the development of youngsters has been 
0 

under intensive study for at least fifty years. In most cases the unit of analysis 
has been the classroom where attempts are made to relate differences in environ- 
mental and interaction variables to differences in student performance. The 

0 

usual approach has been to set up experimental and control groups, to apply the 
"treatment” to the experimental one, and to look for significant differences in 
outcomes between the two groups. Unfortunately, the extensive research utilizing 
this methodoiogy has not come up with a reasonably consistent and reproducible 
set of findings on how differences in schools create differences in human develop- 
ment. 

Certainly one of the reasons for the inability of these experiments to pro- 
vide useful conclusions is the assumption of ceteris paribus , all other things 
being equal between control and experimental groups. Rather, the complexity of 
the world within which education takes place suggests that observed similarities 
between control and experimental groups on one or two dimensions is not adequate 
for the ceteris paribus assumption. Many influences must be accounted 

for in seeking the determinants of scholastic achievement, attitude formation, 
and so on. 

In the last decade a number of studies have attempted to go beyond the stan- 
dard type of educational experiment by using large-scale multi-variate statistical 
models to account for many more variables than could be included in the typical 
control group/experimental group comparison. These studies have related the 
achievement of students to variables reflecting the student’s race, socio- 
economic status, teacher and other school variables, as well as the characteris- 
tics of fellow students. The rather consistent set of findings emerging from these 
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studies suggests that three measured factors are significantly related to stu- 
dent academic achievement: race and socio-economic status of the student as 

.1 

well as the characteristics of his teachers* 

Generally these endeavors have utilized survey data on student achievement, 
socio-economic backgrounds, and school resources to explain variance in student 
achievement. Typically, their findings are based upon fitting a linear regression 
via the ordinary least-squares criterion for the following formulation: 



A i t “ F (B if s it> V 

where A, is the standardized achievement score of the ith student at time t; 
it 

B. represents a vector of family background characteristics at time t; 
represents a vector of school resources such as teacher characteristics, facili- 
ties, student environment created by peers, and so on at time t; and 0^ repre- 
sents community and other characteristics that might affect achievement. These 
attempts might be conceived of broadly as attempts to estimate educational pro- 
duction functions. That is, studies of the educational production process are 

analogous to the econometric effort of estimating production processes in other 
o 

industries. While it is not the purpose of this study to review all of the 
properties of educational production functions and the problems encountered in, 
estimating them, it is useful to discuss briefly a few of these. 



"^See the survey of these studies in James W. Guthrie, George B. Kleindorfer, 
Henry M. Levin, and Robert Stout, Schools and Inequality: A Study of the Relation- 

ships between Social Status, School Services, and Post-School Opportunity in the 
State of Michigan , a report prepared for the National Urban Coalition, Washington, 
D. C. (mimeo, September 1969). 

For a survey of econometric work on production functions see A. A. Walters, 
"Production and Cost Functions: An Econometric Survey," Econometri cs, Vol. 31, 

Nos. 1-2 (January-April , 1963), pp. 1-66. The most comprehensive work on educa- 
tional applications is Samuel S. Bowles, "Towards an Educational Production Func- 
tion." A paper prepared for the Conference on Research in Income and Wealth (Madi- 
son, Wisconsin, November 1968), mimeo. The theory of production can be found in 
any basic text on microeconomics. See for example, William J. Baumol, Economic 
Theory and Operations Analysis (Englewood Cliffs, N. J.: Prentice Hall, 1963), 

Chap. 11. 
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The Focus on a Single Output 



Most studies of the educational production function have used standardized 

achievement scores as the output of the process. Yet, schools are expected to 

3 

produce many outcomes in addition to increasing academic achievement. The for- 
mation of a variety of attitudes and skills as well as many social externalities 
are attributed to the schools.^ An empirical analysis of educational production 

0 

that considers only one output ignores these other outcomes. Only if these 

other outcomes are produced in fixed proportion to the output under scrutiny 

does no problem arise in focusing on a single output such as standardized 
5 

achievement . 

Ideally, the estimation of the educational production process should be based 
upon total educational output. That is, in some way we would want to weight the 
outputs produced by some common factor (utilities, votes, social values) in 
order to obtain a total index of output. Multi-product firms that sell their 
outputs in the marketplace are able to obtain such a measure by using prices as 
weights to obtain a monetary value for total product. Unfortunately, we can 
neither measure all of the outputs that schools are supposed to produce nor do 
we possess a yardstick or "numeraire" to put them into an index of output. 

This focus on achievement scores as the single measure of school output creates 
at least two problems in measuring the educational production process. 



3 For classifications of these, see Benjamin Bloom (ed„), Taxonomy of Educa- 
tional Objectives, Handbook I: Cognitive Domain (New York: David McKay Co., Inc., 

1956); and D. R. Krathwohl, B. S. Bloom, and B. B. Masia, Taxonomy of Educational 

Obj ectives (New York; David McKay Co., Inc.., 1964). 



^fipp Burton Weisbrod. External Benefits of P ublic Education , An Economic 
Analysis (Princeton, N. J.: Industrial Relates Section, Department of Economics 

Princeton University, 1964). 



3 There is no empirical verification for this assumption. 
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First, the single focus on achievement limits the usefulness of educational 
production studies to providing insights for only one dimension of school output. 
The efficient ordering of inputs for producing achievement may be exceedingly 
inefficient for increasing student motivation, efficacy, imagination, and other 
desirable outcomes. This study will attempt to partly reconcile this problem 
by considering relationships among educational inputs and several outputs. 

Second, estimates of the educational production process will underestimate 
the relation between any single output and school resources as long as priorities 
for that output vary among schools. To take an extreme case, academic high 
schools tend to emphasize language skills much more heavily than do vocational 
high schools. Accordingly, equal resources devoted to both groups of schools, 
ceteris paribus would likely have a greater impact on verbal achievement among 
the academic students than the vocational ones. • 

This relationship is further confounded if the priorities of schools vary 
according to the socio-economic composition of their student bodies. Certainly, 
the middle class schools are generally more academically oriented in a college- 
preparatory sense than are the lower class schools which seem to emphasize more 
heavily .the general or job-oriented curricula. In such a case the socio-economic 
background variables of the students act as a proxy for the emphasis on academic 
skills relative to other school goals; and their statistical importance in "pro- 
ducing" academic achievement scores will be overstated while the impact of school 
resources will be understated. 

Educational Production Theory and the Meaning of Production Data 

Estimates of production functions in other industries are based upon the 
assumption that firms are maximizing output for any set of inputs; that is, firms 
are assumed to be technically efficient. Only under these conditions will esti- 
mates relating inputs to output reflect the most efficient way of producing that 



output . 



In order to satisfy that assumption there are at least three general con- 
ditions that must be presumed, (1) The firm has knowledge of the relevant pro- 
duction set; (2) the firm has discretion over the way in which inputs are used; 

# 

and (3) there is an effective incentive that spurs the firm to apply its know- 
ledge of the production set and its ability to combine inputs into maximizing 
output for any set of physical inputs. Under these conditions the observed pro- 
duction data depict the production frontier, the largest output attainable for 

each set of inputs, Whether these are valid presumptions for private firms may 

6 

be open to question# but they are clearly inappropriate ones for the schools. 

There is no basis for asserting that educational decision-makers know their rele- 
vant production sets or that they have a great deal of discretion over how their 
inputs are used. The present organization of school inputs tends to be based on 
sacrosarct traditions rather than management discretion. Finally, the incentives 
of the marketplace that spur firms to be technically (and allocatively) efficient — 
profits, sales, and so on — are conspicuously absent from the educational scene. 

In particular, there is no evidence that educational firms such as schools and 
school districts maximize standardized achievement. Thus, at best the observa- 
tions on inputs and outcomes represent average ones under the present state of 
♦ 

operations, not maximum or technically efficient ones. 

Moreover, the lack of knowledge on the relevant production set means that one 

f 

cannot specify with reasonable accuracy the inputs germane to any particular output. 
Specification of the educational production model must depend more on intuition 
and hunch than on a body of well-developed behavioral theory. That is, there is 
no well-validated theory of learning on human development which can be used as a 



For a discussion of their relevance to estimating production functions for 
industry, see Dennis Aigner and S. F. Chu, "On Estimating the Industry Production 
Function," American Economic Review (September 1968), No. 4, pp. 826-839. 
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guide in specifying inputs and the general functional relationships between inputs 
and outputs. In the absence of such a foundation, much of the early work in esti- 
mating educational production relations has necessarily involved a hunting expedi- 
# 

tion into the deep entangled forest of possible educational influences. The prob- 
lem with such an expedition is that we have been like hunters shooting at anything 
that moved since we have had no clear picture of the animals that we wanted to 
collect. 

A second and related problem is that even when we do know what kind of con- 
ceptual animal we wish to bag, we do not know how or where to capture it. Clearly, 
innate intelligence should be considered as an input when attempting to estimate 
the educational production function for achievement. Yet, like the mythical uni- 
corn there has been much written about innate intelligence, but no one has ever 
seen one. That is, we have no way of measuring this important determinant of 
educational outcomes. Moreover, measures of teacher proficiency or other school 
inputs are not available. Rather we must use such conventional indicators as 
teacher experience, degree level, number of books in the library, and so on in 
the hope that we are capturing some of the actual influences of which we are 

% 

unaware or which we are unable to measure adequately. 

The result of both not knowing how education is produced and not being able 

to measure many of the inputs suggests a high probability of bias in the estimates 

of the production coefficients. The exclusion of variables that belong in the 

.7 

equation as well as the inclusion of erroneous variables all lead to such biases. 
Moreover, the fitting of such data to a linear function can also result in speci- 
fication biases in a world that is characterized by non-linearities. Ail of the 



^Henri Theil, "Specification Errors and the Estimation of Economic Relation- 
ships," Revere Institute Internationale de Statistique , Vol. 25 (January 1957), 
pp. 41-51. 




empirical studies of the educational production process are prime candidates 

for such biases. 

Data Refinement 
0 

Perhaps it is useful to divide data problems into two types: intransigent 
and remediable. In actuality this dichotomy is a state of the art distinction 
rather than one which is in the stars. At a future time, intransigent difficul- 
ties may be alleviated by greater knowledge of the phenomenon or by better 

* 

measurement techniques. Examples of the former problem are our inability to 
measure innate abilities. As we noted above, the omission of such a variable is 
likely to induce a bias in our estimates. In such a case it is important that 
we explore the biases from not including such a measure in the specification of 
our production model, but we can do little beyond this. 

On the other hand, data deficiencies arise that are partly or fully reme- 
diable. For example: a needed item is sufficiently measureable, 

but it was omitted from the survey on which the production estimates will be 
made. In such a case, one can attempt to find a close proxy among the existing 
information source or one can resurvey to obtain the missing item. The latter 
alternative is time-consuming and costly, so it is often the former course of 
action that is taken. Yet, the use of a proxy or surrogate piece of information 
is subject to the vagaries of interpretation, and its use may create more prob- 
lems than it solves. 8 In many cases it may be wise to acknowledge the omission 
and to speculate on the resulting bias rather than to use a questionable proxy. 



8 As an illustration, Bowles uses the number of days that the school was in 
session as a proxy "...to represent the general level of community interest in 
and support of education." o£. cit . , p. 49. Yet, such an indicator is more like- 
ly to be governed by State mandate than by community educational interests, edu- 
cational support, and political processes. That is, each State requires a mini- 
mum session in order for the school district to qualify for aid. Accordingly, 
the maia variance in the measure is accounted for among States. For the national 
sample used by Bowles the mean for the "days-in-session" variable was 180 and 
the standard deviation was only 4. 



Yet, in all too many instances data problems are remediable, and in those 

cases the information should be refined to more closely approximate the concept 

which they are expected to represent. Most studies examining the educational 
* 

production process have used school data for each student whether the student 

had actually attended the school in the past or whether he hadn't. For example, 

the EEO purvey was undertaken in September-October of the 1965-66 school year. 

Clearly the relevant school data for each child are those pertaining to the 

schools' that he actually attended, and in many cases the school that he was 

attending in 1965-66 was different from those that he had previously attended. 

That is, the high rate of residential mobility is translated into school mobility, 

and present school factors may be erroneous measures for actual school charac- 

q 

teristics unless some data refinement is attempted. 

To the degree that the school factors used in the analysis are spurious 

10 

ones, the estimated effect of them on achievement will be biased downward. 
Unfortunately, this problem pervades the EEO work as well as its reanalysis, 

and the problem is more serious among the analyses for blacks and other minorities 

< 

than for whites because of the higher mobility factor among the former groups. 

One way of correcting for this source of error is to include in the sample only 
those students who had received all of their education in the schools which they 
were currently attending. That is the approach taken in this study. Another 
possibility is that of obtaining historical data on all of the schools that the 
students attended. Given the fact that much school mobility is among school 
districts and states, this task may be beyond the realm of practicality. 

9 ’ 

See S. Bowles and H. M. Levin, "The Determinants of Scholastic Achievement — 
An Appraisal of Some Recent Evidence," The Journal of Human Resources , Vol. Ill, 
No. 1 (Winter 1968), pp. 3-24. 

10 

See John Kain and Eric Hanushek, "On the Value of Equality of Educational 
Opportunity as a Guide to Public Policy," Program on Regional and Urban Economics, 
Discussion Paper No. 36, Harvard University (May 1968). 
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Other data problems that are remediable are those resulting from missing 

observations of items for particular students. The EEO Survey suffered parti- 

11 

cularly from these hindrances. There are many ways of handling this problem, 

12 

but ignoring it is clearly not one of them. A final difficulty that charac- 
terizes the data sets used for measuring educational production is the inter- 
dependence among the so-called explanatory variables. In general, a child’s 
home background and his school are highly correlated in that higher socio-economic 
status children attend schools with greater resource endowments. This factor has 

prevented many studies from obtaining reliable estimates of the separate effects 

13 

of school and background characteristics on achievement.' One way of circum- 
venting this difficulty is to carry out the analysis for stratified subsamples 

14 

of students with homogeneous socio-economic backgrounds. 

Purpose of This Study 

While we have noted some of the problems that arise in applying econometric 
analysis of production to the schools, this study will not make the heroic claim 
of having avoided such pitfalls. Rather, this effort addresses itself to moving 
towards estimating a model of the schools that more nearly mirrors What we know 
of the educational process. Indeed, we will proceed in the following way: First, 

we will posit a model of the schools and compare it with the more traditional 
formulation; second, we will discuss the data that will be used to estimate the 
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See S. Bowles and H. M. Levin, 0 £. cit . , pp. 6-7. 

12 

See Janet Elashoff and R. M. Elashoff, "On Regression Analysis with Missing 
Data," Computers, Data Bases, and the Social Sciences , Ralph Bisco (ed.), 

John Wiley & Sons, forthcoming. 

TO 

This has been discussed at length by Bowles and Levin in "The Determinants 
of Scholastic Achievement," and by the same authors in "More on Multicollinearity 
and the Effectiveness of Schools," The Journal of Human Resources (Summer 1968), 
pp. 393-400. 

■^This has been attempted in Herbert Riesling, "Measuring a Local Government 
Service: A Study of School Districts in New York State," Review of Economics and 

Statistics (August 1967), pp. 356-367. Also see James W. Guthrie, et al » , op . cit . , 
pp. 135-144. 
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structure of the model; third, we will review the estimation procedure and 
results; and finally, we will discuss the implications. 

Specification of the Model 

Most studies of educational production have not attempted to specify in 
a systematic way the particular formulation of how schools affect achievement. 
Rather, they have taken a set of school and student background factors and re- 
lated them statistically to achievement without discussing the underlying be- 
havioral assumptions implied by their work. One exception has been an important 

1 S 

study by Eric Hanushek that did posit a more concrete model of achievement. 

The following formulation is based upon Ranusek's foundation. 

Assume that we wish to examine the determinants of student achievement at 
a point in time. Clearly, that achievement level is related not only to the 
present influences that operate on that student, but also to past ones. That 
is, from the time a child is conceived various environmental characteristics 
combine with his innate characteristics to mold his behavior. More specifically, 
a child's achievement performance is determined by the cumulative amounts of 
"capital" embodied in him by his family, his school, his community, and peers as 
well as his innate traits. The greater the amount and the quality of investment 
from each of these sources, the higher will be the student's achievement level. 
Thus, a student's academic performance is viewed to be a function of the amount 
of different kinds of capital embodied in him. 

The general formulation of the capital embodiment model is as follows: 



where the i subscript refers to the ith student; the t subscript refers to time 
period t; and the t subscript in parentheses (t) refers to being cumulative to 

15g ee Eric Hanushek, The Education of Negroes and Whites (Unpublished Doc- 
toral Dissertation, Massachusetts Institute of Technology, 1968). 



( 1 ) 
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time, period t. Thus: 

A. - a vector of educational outcomes for the ith student at time t. 

JL L. 

F., v = a vector of individual and family background characteristics 
• ^ ' cumulative to time t. 



i(t) 



= a vector of school inputs relevant to the ith student cumulative 
to time t. 



P., . = a vector of peer or fellow student characteristics cumulative to t. 
•x(t) 

0., v = a vector of other external influences (community, etc...) relevant 
^ ' to the ith student cumulative to t. 

I. = a vector of initial or innate endowment of the ith student at t. 
xt 

It is assumed that % is positive for all these arguments or that the 

marginal product of additional capital embodiment from any one of the five 

16 

sources has a positive effect on student educational outcome. 

This formulation reflects the well-accepted concept that a child receives 
his educational investment from several sources in addition to the school. For 
example, the family provides a material, intellectual, and emotional environment 
which contributes to the child’s performance level. Likewise, the school, peer 
groups, and community affect both learning and emotional behavior of students. 
Yet, in order to^ estimate these effects, one must take this general formulation 
and* make it more specific. 

Suppose we wish to follow the examples of other researchers by estimating a 
production function for achievement. Again, we can view a student’s level of 
achievement on a verbal test, for example, as a function of his capital embodi- 
ment from several sources as well as his innate traits. But, in addition to 



1 

Following the capital embodiment approach more strictly, Dennis Dugan has 
calculated the monetary value of parents’ educational investment in their off- 
spring by calculating the opportunity cost or market value of such services. 

The values of father’s educational investment, mother’s educational investment, 
and school investment (all measured in dollars) seem to have high combined pre- 
dictive value in explaining achievement levels. See Dennis Dugan, "The Impact 
of Parental and Educational Investments Upon Student Achievement," Paper pre- 
sented at 129th Annual Meeting of the American Statistical Association (New 
York City, August 21, 1969), mimeo. 
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these sources of capital embodiment, his educational achievement at a point 
in time is likely to be related to his educational attitudes and his parents' 
educational attitudes. More specifically, we might postulate that: 



( 2 ) 



where 




s i(t), p i(t), °i(t), 









Al it = the achievement level of the ith student at t 

Fi(t), s i(t), p i(t), and are as previously defined; 

A2 lt “ a measure of the student's sense of efficacy or fate control at t 

A3it - a measure of educational motivation of the ith student at t 

A4tt ~ parents' educational expectations for the ith student at t 

That is, we would expect student achievement to be higher the greater his 
sense of efficacy, his educational motivation, and his parents' expectations, 
ceteris paribus * By efficacy we refer to the student's feeling that he has a 
measure of control over his destiny, that it does not depend strictly on chance. 
Educational motivation refers to the desire to succeed in an educational sense 
(for example, the desire to get good grades and to attain additional schooling). 
Parents' educational expectations might be viewed as how well the parents expect 
the child to perform by educational criteria. 

But these three variables are of more than passing interest because not 
only do they affect achievement levels, but they themselves are affected by 
achievement . This raises the question of whether a single equation is adequate 
for estimating educational production^even when one is concerned with only a 
single measure of output such as achievement. That is, the single equation 
model tacitly assumes that each of the explanatory variables is determined out- 
side of the system; that is they are exogenous. In other words, the explanatory 
variables influence the level of student achievement, but student achievement is 
assumed not to influence the so-called explanatory variables. 
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An Illustration of this assumption and its lack of realism in the present 

instance is useful. Let us start off with a very simple model of achievement 

where student efficacy is considered to be the only factor affecting student 
* 

achievement, all other factors being held constant. We can present this 
simple paradigm by drawing an arrow showing the causal direction that is 
assumed : 

Student Achievement <r Student Efficacy 

This simple depiction suggests that student achievement is greater the 
higher the level of efficacy. In process terms, students who believe that 
they have a measure of control over their achievement level are more likely 
to try to do well than students who believe that it all depends upon luck. 

But it is probably also true that the higher the level of his achievement, 
the higher the level of his efficacy. That is, by doing well his sense of 
fate control is enhanced or reinforced because his efforts can really 
make a difference in his achievement. Thus, achievement stimulates 
efficacy and efficacy stimulates achievement as depicted below: 

Student Achievement ^ Student Efficacy 

Moreover, the other attitudinal variables that influence such school 
outputs as standardized achievement performance are also influenced themselves 
by student achievement and by each other. For example, parents' educational 
expectations for a student will affect the student's performance level; but 
the student's performance level will also affect the parent's educational 
aspirations for him. Most parents will expect less from a child who has 
consistently low test scores and grades than one who has higher levels of 
both attributes. The same is probably true of teacher expectations for 
pupil progress. In summary, many crucial variables in the educational 
process interact in such a way that we cannot take their levels as given 

o 
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in order to predict other factors. Rather both explanatory variables and 
those which we wish to explain are interdependent, and their values must 
be solved simultaneously in order to obtain unbiased estimates of their 
effects. 

That is the following relationship exists in concept. In this par- 

t 

ticular system, everything 




depends upon everything else, so that complete simultaneity exists. Every 

one of the variables is linked by a double arrow to every other variable. 

In actuality the simultaneity may be complete or partial, but in either 

case the ordinary least-squares solution of equation (2) will lead to 

17 

biased and inconsistent estimates. Rather, we must estimate the full 
set of equations representing the simultaneous equations system. 

17 That is, the residual term is likely to be correlated with A 2 i t) 
A-3it> and Mitj and the direct application of the ordinary least squares 
estimator will not yield unbiased estimates of the structural parameters 
of (2). See J. Johnston, Econometric Methods (New York: McGraw Hill 
Book Company, 1963), Chap. 9. 
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